Pairing instabilities in topological insulator quantum wells 
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Topological insulator quantum wells with induced attractive interactions between electrons are 
candidate systems for the realization of novel vortex lattice states with time-reversal symmetry, 
and incompressible quantum vortex liquids with fractional excitations. We analyze the competi- 
tion between different pairing channels stimulated by the superconducting proximity effect in these 
quantum wells, and calculate the helical triplet pairing instability that can produce the mentioned 
phases using perturbation theory. We discuss the phase diagram tunable by gate voltage. 



All topological insulator (TI) materials discovered so 
far are band-insulators—. They have gapless states 
at their boundaries^ in common with integer quantum 
Hall systems, but respect the time-reversal (TR) sym- 
metry. As in any band-insulator, their bulk excitations 
are conventional electron and hole quasiparticles. Since 
the Rashba spin-orbit coupling in TIs can be viewed 
as a source of an effective SU(2) magnetic field for 
electrons^ - — , it is natural to ask whether other observed 
behaviors of electrons in magnetic fields could be repli- 
cated with the TR symmetry in TIs. Especially inter- 
esting possibilities to look for are the TR-invariant in- 
compressible quantum liquids similar to fractional quan- 
tum Hall states^—, but with potentially novel kinds 
of SU(2) dynamics that could be applied in quantum 
computation 11 . There are very few practical proposals 
and ideas for the realization of such states^r— . 

Here we show by a model calculation and phenomeno- 
logical arguments that a TI quantum well in contact 
with a superconductor (FigJT]) can host Abrikosov lattices 
of SU(2) topological defects, and topological pseudo- 
gap insulators whose excitations carry fractional charge 
and statistics. The SU(2) vortex lattice, which is 
TR-invariant in normal circumstances, arises when the 
Rashba spin-orbit coupling and induced interactions cre- 
ate helical p-wave Cooper pairs and stimulate their con- 
densation in the TI. Related states have been found in 
two-component boson model calculations^ 4 ^. Quantum 
melting of this vortex lattice can be tuned by the gate 
voltage, and produces fractional incompressible quan- 
tum liquids in analogy to bosons in effective magnetic 
fields^ - — . Fermionic excitations remain gapped by the 
TI surface hybridization across this melting transition. 

Electrons in the TI quantum well acquire short-range 
attractive interactions by proximity to a conventional su- 
perconducting (SC) material 2 -. Any charge-carrying ex- 
citation in the quantum well can displace the SC's atoms 
near the interface, and thus attractively interact with an- 
other TPs excitation via emission and absorption of the 
SC's phonons. The Coulomb origin of this interaction 
makes it spin-independent, and its range is short due to 
screening that takes place in the SC. Furthermore, the 
virtual Cooper pair tunneling from the SC can dynam- 
ically generate spin-dependent pairing forces in the TI, 



FIG. 1: The heterostructure device that can host fractional 
TR-invariant quantum states. A topological insulator (TI) 
quantum well is sandwiched between a conventional super- 
conductor (SC) and a conventional insulator (I). The gate 
(G) voltage can be used to control the state of the TI, and 
the topological properties of the TI can be probed via a Hall- 
bar setup of leads (L). 



which are short-ranged due to the SC's Meissner effect. 

The current proximity-effect experiments that seek 
Majorana fermions are focused on the interfaces between 
conventional SCs and bulk TIs^2r— . However, our inter- 
est here is the interface between a SC and a TI quantum 
well in Fig[TJ Having a small inter-surface hybridiza- 
tion bandgap, electrons in the TI quantum well need not 
automatically form a superconducting state when sub- 
jected to the proximity effect. The two-dimensional ge- 
ometry greatly amplifies the ability of the induced attrac- 
tive interactions to form bound-state Cooper pairs in the 
quantum wel l 39 ' 40 , which then can survive as low-energy 
gapped excitations in correlated insulating states. 

A TI quantum well provides four electronic degrees of 
freedom ip TrT at low energies: two spin states a z , and two 
orbital states r z equivalent to the top/bottom surface of 
the quantum well. Being largely independent of spin, the 
proximity-induced interactions in the TI can in principle 
lead to Cooper pairing in a variety of channels: intra- 
orbital spin-singlets <j) T — e a ptp TOl ili T ^, inter-orbital spin- 
singlets 4>q = e a pip +a Tp_p, and inter-orbital spin-triplets 
r] a = ip +cr ip-a- and n = ip + ^ip_ i + ip +i yj_ t . Some paired 
modes may exist as excitations at energies below the two- 
electron continuum. Their dynamics is qualitatively cap- 
tured by the imaginary-time (t) Landau- Ginzburg action 
that implements the Rashba spin-orbit interaction via an 
external static SU(2) gauge field A. oc xS v — yS x coupled 
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to triplets (S a are the S = 1 spin-projection operators) 



\29. 



Sett = 



dt d 2 r 



{K s {d^ (d^+UU (1) 

+K t [dp — iAp) rj ipn-iA^r] +^7] 

+U s {tf<j>) 2 + u t tfv) 2 + ttttftfltfri) + •••}• 

For simplicity, we keep track of only the lowest-energy 
singlet hybrid mode 4>, and denote by ellipses any terms 
not involving A. that violate the spin SU(2) symmetry. 

Our main interest here is triplet pairing, because it can 
lead to novel Abrikosov lattice superconducting states 
and fractional topological insulators as we will show. 
Triplets are typically inferior to singlets since their elec- 
trons can overcome the Pauli exclusion only by being 
further apart. However, the spin-orbit coupling in TIs 
gives them a special advantage. It creates two helical 
triplet modes whose spin is perpendicular to their mo- 
mentum, analogous to the Dirac electron modes in band- 
insulating TIs. Since the Rashba spin-orbit coupling acts 
as a momentum-dependent "Zeeman effect" , one helical 
mode has energy that decreases with its momentum. A 
helical triplet condensate forms beyond the momenta at 
which this mode's energy vanishes, provided that such 
momenta lie below the cut-off momentum A set by the 
crystalline lattice. Even a naturally large triplet mass 
scale it is not likely to jeopardize the helical condensate 
because A is large. In contrast, singlets can condense 
only at the zero momentum provided that their gap t s is 
closed by tuning the gate voltage. 

Let us first explore the competition between the sin- 
glet and triplet pairing in the TI. The gate voltage V g di- 
rectly controls all chemical potential couplings, because 
all fields are charged: t s = t s0 — 2eV g and t% — <to — 2eV g , 
where e is the electron charge. Suppose that singlets 
condense first from an insulating state of the TI, at some 
gate voltage that makes t s < < t t . The singlet order 
parameter can be estimated from the mean-field approx- 
imation, \cf>\ 2 — \t s \/2U s . A further increase of the gate 
voltage only increases \(f>\ 2 , and tends to screen out the 
triplets via the singlet-triplet repulsive interaction t' s > 0. 
The effective quadratic coupling for triplets is: 



j-eff _ . 



2eV g + t' s \^\ 2 = *«, - 2eV g 



wj ts0 



2eK 



t5? ff < and hence condense the triplets. This condition 
is likely satisfied in realistic systems owing to the Pauli 
exclusion among the electron constituents of the Cooper 
pairs. Two singlet pairs have electrons in exactly the 
same quantum states and hence repel each other at short 
distances (U s ) more strongly than a singlet-triplet pair 
(t' s ). Similarly, if triplets were to condense first, singlets 
could condense later at a larger V g . This mechanism 
for simultaneous order parameters could be halted if the 
needed eV g is larger than the cut-off of the theory (fTJ). 
Note that we have omitted the description of Coulomb 



forces in (fTJ because they cannot lead to gate screening in 
a thin quantum well (this type of screening is detrimental 
to coexisting order parameters in 3D superconductors). 

The spin dynamics of triplets, which can be topolog- 
ically non-trivial, is observable via spin-transport mea- 
surements even in the presence of a singlet condensate 
because singlets cannot screen spin. We will, however, 
simplify further analysis by focusing on the triplet pairing 
instability in the band-insulating state of the TI quantum 
well. Analogous calculation involving the 2D unscreened 
Bogoliubov quasiparticles instead of electrons would pro- 
ceed in the presence of a background singlet condensate, 
with qualitatively similar results. The pairing instability 
of r) a , where a = ±1 is the spin projection on the z-axis, 
can be qualitatively captured by the effective action of 
the TI electrons ip Ta : 



S = 



dtdr 2 



d 

V> f ( — + uz(S x p)t 2 
dt 



h.c. 



(2) 



The non-interacting spin-orbit Hamiltonian Hq in the 
first line has eigenstates |p<?s) labeled by the follow- 
ing quantum numbers: momentum p, "helical" spin a 
(the eigenvalue of the operator a z = (z x p)er, where a 
are spin Pauli matrices), and the band- index s = ±1. 
The energy levels Ej(p) — se(p) — fi, where e(p) = 

3 |p| 2 w 2 + A 2 , have no helical spin dependence. They 
determine the bare electron Green's function in real time: 



Gs(p,w) 



1 



(j, — se(p) + iC^ 



(3) 



The inverse pairing susceptibility H aa > (q^) of the inter- 
orbital triplets 77 CT is obtained from the Feynman diagram 
in the Figj2j Vertex functions in this diagram are deter- 
mined by the eigenstates of Hq expressed in terms of the 
pure spin projection states on the z-axis, which are used 
to represent the ry CT Cooper pair wavefunctions. After a 
straight-forward calculation we find at T = 0: 



fW(<? M ) = v 



d p 



A 2 



lit' s /2U s < 1, then a large enough gate voltage will make n o - ) _ cr (g jU ,) 



— i2crip(q) 



\d\ 2 v 2 



d 2 p 

(2tt) 2 16e(p-)e(pH 



W^(P ± ) 



l^(p d 



e(p-) + e(p+) 
[e(p-) + e(p+)] 2 -(2^ + ny 



ip(q) = &ig(-q y + iq x ) 



(4) 



where the angle y(q) points in the direction perpendic- 
ular to the momentum p, and pj = ±p M + ^q^. The 
integral in II (T(T ((7 A1 ) is ultra-violet divergent and has to 
be regularized by adding 1 / 4nA to Yl aa , which explicitly 
depends on the momentum cut-off A. 
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FIG. 2: The triplet-channel pairing Feynman diagram. The 
solid lines represent the electron propagators (3). The spin- 
orbit coupling does not conserve spin, so the incoming a and 
outgoing a' Cooper pair spins can be different. 

The relativistic nature of the Cooper pair spectrum 
is already evident from There are Cooper pairs 

of particles and pairs of holes, which are energetically 
equivalent when the electron spectrum has particle-hole 
symmetry (// = 0). Also, the factor e 12 ' 7 ^^ in H <rt ^ a (q IJj ) 
reveals that the triplet pairs are spin-orbit-coupled and 
have a twice larger spin-orbit SU(2) charge than elec- 
trons. The effective action for r\ a takes the form: 

^ {%) %{%) > \ KM n u (« M ) J [ % (q») ) 

where II n (^) = II u (g M ) and U lt (q^) = The 
actual helical modes rj± exhibit spin-momentum locking 
and are superpositions of i}f and ryj. whose inverse Green's 
functions Tl±(q li ) are obtained by diagonalizing the above 
matrix: 

n±(g M ) = ± |n CT ,_ CT (^)| . (6) 

The absence of a solution to H±(q fl ) = would indi- 
cate that a coherent bosonic mode does not exist, while 
n±(<Z/j) < at ft = indicates pairing instability. We 
will numerically analyze the mode dispersions by express- 
ing Tl±(q f _ l ) in the scaling form: 

The interaction parameter V has the dimensions of mass 
in d = 2, and is normally positive and inversely pro- 
portional to the strength of triplet-channel attractive in- 
teractions induced by the proximity effect. By applying 
a gate voltage, V can be turned negative. Note that 
the functional form ([7]) that we obtain from the one-loop 
approximation is accurate to all orders of perturbation 
theory when expressed in terms of the renormalized pa- 
rameters (because the ground state is fully gapped). 

We will not make reference to particle versus hole char- 
acter of the Cooper pairs, but rather exploit the symme- 
try under O + 2/i — > — (17 + 2/j). The figure [3] shows 
the energy dispersion fl-(q) of the important heli- 
cal mode, obtained from II_(g, S7) — 0. The smallest 
momentum at which condensation occurs is <7 m i n , where 
^-(<Zmin) = 0. Interactions between Cooper pairs must 
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FIG. 3: Energy dispersions of the critical helical triplet mode. 
The plots of fi-(q) are parametrized by the rescaled inverse 
interaction strength Vv 2 /2A at a fixed bandgap A. Un- 
shaded regions indicate the continuum of unpaired electron 
states where Im(II„) 0. Increasing q and following a con- 
tour eventually brings a finite mode energy to zero at some 
q = 9mm where condensation can occur. All modes beyond 
q > q-mi-a are condensed as well because IT_(q,0) is negative. 
This massive instability shows that the triplets tend to con- 
dense at finite momenta, where their modes are rotationally 
degenerate. Only if q m i n > A, the momentum cut-off, the 
modes that would condense do not exist and the insulating 
state remains a band-insulator. Note that g m j n grows by in- 
creasing the bandgap or decreasing the interaction strength. 



resolve the massive degeneracy of simultaneously con- 
densing modes with different momentum orientations in 
our continuum model. This frustration is not blunted 
by the presence of a lattice in materials because a large 
number of modes at q > <7 m ; n are also unstable, having 

n_( 9 ,o)<o. 

A finite-momentum condensate is spatially non- 
uniform in equilibrium. If a helical condensate formed at 
only one momentum q, it would coherently carry charge 
and spin currents. In order to eliminate the charge cur- 
rent, an equal- amplitude condensation should occur at 
the momentum — q as well. However, the helical triplets 
have their spin locked to momentum, so a finite uni- 
form spin supercurrent survives in this state and cannot 
be eliminated in a finite-momentum condensate. The 
only way to establish equilibrium without currents flow- 
ing across the system is to organize all spin supcrflow 
into closed loops. Therefore, the helical condensate must 
be a vortex state, generally an Abrikosov lattice of SU(2) 
topological defects that minimizes the vortex core energy. 

The actual helical condensate ?y_ is also contributed by 
a finite-momentum condensation of rjo , which can be seen 
from ([1} because the S = 1 spinor perpendicular to both 
p and z has all rj-f, T)^, 770 7^ 0. Such spinors ?7-(q) and 
r]-(— q) carrying opposite spins are orthogonal, so their 
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counter-circulating charge currents in an SU(2) vortex do 
not interfere. Spatially separating the vortices of f?-(q) 
and j]- (— q) would therefore not save energy on supercur- 
rents, but would add to the energy cost by doubling the 
number of vortex cores. For this reason, the ground-state 
is indeed a TR-invariant SU(2) vortex lattice. Note that 
the mode interactions in (JTJ) encourage the simultaneous 
condensation of 7?-(q) and rj-(— q). 

The phase diagram of the TPs helical pairing insta- 
bility is plotted in the Figure 2] The two practical tun- 
ing parameters are the quantum well bandgap A (con- 
trolled by the well thickness), and the chemical potential 
\x (tuned by the gate voltage). The present model fea- 
tures two special bandgap values A 12 - If A < Ai, the 
quantum well superconducts for any applied gate voltage, 
and if A > A2 the ground-state is either a band-insulator 
or a BCS superconductor depending on /1. The shaded 
colored area is a helical superconductor with a vortex 
lattice, which competes with a singlet superconductor 
shaded in the lighter color. Both can coexist under the 
circumstances discussed earlier, but the relative positions 
of their pairing transitions cannot be determined in the 
present qualitative calculation. The helical mode is co- 
herent in the insulating phase and its q — A gap grad- 
ually closes on the approach to the transition shown as 
the dashed thick red line. 

However, the perturbative picture is not entirely ac- 
curate. Coming from the helical superconductor side, 
the quantum zero-point fluctuations lead to a first-order 
vortex lattice melting transition (depicted by the thin 
dashed black line) before the perturbative second-order 
transition can take placed. This means that there is at 
least one intervening correlated insulator phase between 
the superconductor and the band-insulator, a quantum 
vortex liquid which is an excellent candidate for a frac- 
tional topological insulator (an incompressible quantum 
liquid of bosons with chiral spin dynamics). 

The idealized model considered here has a U(l) sym- 
metry associated with the helical spin a z conservation 
(which depends on momentum conservation). This de- 
couples the helical pairs r)± from all others in (H}, so the 
above analysis is self-contained and we only ought to ask 
how the spinless channels compete with the spinful ones 
in order to understand the full phase diagram. Lacking 
the SU(2) symmetry, spinless channels can be coupled 
together. Among their mixtures, the modes with pro- 
nounced inter-orbital singlet tfto or symmetric triplet 770 
amplitudes are unlikely to be dominant anywhere in the 
phase diagram. This is because the lowest energy <fio and 
770 Cooper pairs of not too large size are made from two 
electrons with roughly opposite momenta, opposite spins 
and opposite r z orbitals, which tends to place them in the 
different spin-orbit bands and impose the full bandgap as 
a hurdle to pairing by weak interactions. The intra-band 
singlets are the main competitors to helical triplets. 

Realistic TIs do not have any spin-related symmetry 
at least due to disorder. For this reason, a realistic model 
should not conserve the number of any type of Cooper 
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FIG. 4: The phase diagram of helical triplet superconduc- 
tivity in the TI quantum well at a fixed interaction strength 
V. The unshaded areas are metallic in the absence of in- 
teractions, and become superconducting with any amount of 
attractive interactions via the BCS instability. The colored 
shaded areas feature gapped fermionic quasiparticles and co- 
herent helical triplet modes below the quasiparticle gap. As 
illustrated in the Fig(3J the helical mode gap closes at some 
finite wavevector q — q m in- If bosonic modes still exist at 
such a wavevector, they condense into a vortex lattice state. 
Alternatively, quantum fluctuations can melt this vortex lat- 
tice and yield a strongly correlated topological insulator of 
Cooper pairs. The labeled contours correspond to fixed val- 
ues of <2 m in/A calculated from where A is the momentum 
cut-off. When q m i n > A, the ground-state is a band-insulator 
shaded in gray. The helical superconductor competes with 
singlet superconductivity whose dome-shaped boundary arbi- 
trarily exemplified by the white line can appear anywhere in 
the bandgap, depending on the microscopic parameters. 



pairs (only their total charge is conserved), and terms 
such as T?|<^ are allowed in ([T]). Consequently, a conden- 
sate driven by any channel will have phase-locked con- 
tributions from other channels. There is a certain frus- 
tration to be resolved, because the spinless Cooper pairs 
prefer to condense into a uniform state, while the spinful 
ones prefer to form a vortex lattice. Indeed, depending on 
which condensate component is dominant, the supercon- 
ducting state will either be uniform or host a vortex lat- 
tice, and its transformation under translations, rotations, 
etc. is the only qualitative property that can distinguish 
it from the other superconducting states. However, the 
phase-locking is not efficient in TR-invariant vortex lat- 
tice states, because they have no net charge supercurrents 
to drag a singlet supercurrent. 
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